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ABSTRACT 

The report evaluates the Jilingual-Bicultural Project 
conducted in 1981-82 at Clara Barton Hign School, in Brooklyn, New 
York, for 50 Spanish speaking students with limited English 
proficiency (LEP). The project was designed to provide tutorial 
support to LEP students and to enable them to be placed in one of the 
jmore challenging health profession majors offered at the school. 
Additional help was provided to students in both English and Spanish 
language achievement, and in content area courses. The' pro ject also 
sought to help students to organize thefir studies, develop learning 
skills, and bolster their motivation to remain in school despite 
financial, cultural, and academic pressures. Quantitative analysis of 
student achievement among participants indicates that: (1) Spanish 
speaking students mastered 1.7 objectives per month of instruction; 
(2) program students demonstrated gains in pre- and posttest reading 
scores; (3) students in grades 10 and 12 demonstrated gains in 
.mathematics performance; and (4) program students had better 
attendance rates than the school average. The report' of fers several 
recommendations regarding data collection and recordkeeping, 
scheduling of tutorial sessions, assessment of program impact, 
additional second language assistance, more challenging native 
language classes, formation of a bilingual club, and modification of 
the program objective concerning the Criterion Referenced English 
Syntax Test (CREST). (AOS) 
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A SUMMARY OF THE EVALUATION 
FOR THE BILINGUAL PROJECT 
CLARA BARTON HIGH SCHOOL 
/ 1981-1982 



This/program, 1n Its first year of funding, provided tutorial 
services to .a/target group of fifty Span1sh-speak1 ng students of limited 
English proffdency (LEP) 1n grades nine through twelve. More than half 
of the program students were born 1n the continental United States; others 
were born 1/h Puerto R1co and the Dominican Republic, as well as other 
Central and South American countries. Jhe school 1s not zoned, but selects 
applicants from any part of the dty who want to prepare for one of nine- 
health pr/ofesslons , and 1s organized as a "m1n1-college." Of the fifty 
program students, 45 came from communities 1n Brooklyn. Although program 
students varied 1n English-language proficiency, ability 1n Spanish! 
and ovieral'l academic preparedness, all took full programs of academic, 
vocational, and mandated courses 1n the mainstream. 

i The major goal of the program was to provide tutorial support 
to/LEP students, thus enabling them to be placed 1n one of the more 
challenging health profession majors. (No formal E.S.L. Instruction was 
available during 1981-1982 because the E.S.L. teacher who taught the course 
; the previous year was on sabbatical.) In addition to helping students 
progress 1n both English- and Spanish-language achievement and content- 
area courses, the program sought to Instill confidence and to help, 
students organize their studies and develop learning skills. The program 
also hoped to offer students a unit within the school with which to 
identify 1n an effort to bolster their motivation to remain 1n school 
despite financial pressures, cultural adjustments, and possible limita- 
tions 1n the education they received 1n the native country. 
• ■ . \ 

The project received Title VII funding for two full-time staff 
positions: the project director responsible forVprogram Implementation 
and a paraprofesslonal who handled clerical tasks" and record-keeping. 
Both staff members tutored students on an Individual basis during -lunch 
periods. Actual services received by students were difficult to document, 
however, since the project had not maintained a log of students who 
sought or received services. Supportive services* to program students 
Included tax-levy services from the school' s grade advl sors and guidance 
counselors and Informal advice and encouragement from program staff. 
Both program staff members attended university courses; no other staff 
development activities were reported. Parents of program students 
participated 1n a Parents Bilingual Advisory Council. Parental partici- 
pation was limited, however, since the school is not neighborhood-based. 



-lb 

Although 1t was difficult to assess the impact of the program's 
tutorial services, the potential Impact on the school's admissions and 
programming policies may be significant. An increase 1n the number of 
Spanish-dominant students was expected, in addition to the placement of 
program students 1n the more demanding majors. 



Students were assessed in English-language development (Criterion 
Referenc ed English Syntax Test [CREST]); reading 1n English (NewJofk C1ty_ 
Reading Test); mathematics performance (P. S.E.N. ) ; and attendance Cschool 
and program records). •Quantitative analysis of student achievement 
indicates that: , 

--In general, Spanish-speaking program students mastered 
1.7 objectives per month of instruction on the CREST. 

--Overall, program students demonstrated large- gains from 
the pre- to the. post-test on the New York City Reading 
Test (P.S.E.N.). _ 

--Tenth- and eleventh-grade students demonstrated statistically 
and educationally significant gains on the P. S.E.N. The 
gains made by twelfth-grade students, although not quite 
statistically significant, were very educationally significant. 

--The attendance percentage of program students was 6.7 
percentage points higher than the attendance percentage 
of the school . 

<, . ■ 
The following recommendations were aimed at Increasing the 

overall effectiveness of the program: 



--Record-keeping procedures should be Implemented and maintained 
on a dally basis to document the number of students served 
by the program, the frequency of tutorial sessions, subject 
areas covered, language(s) used, and materials used. Any extra 
work done by students should also be maintained 1n folders 
N in order to better monitor individual progress; 



--Student achievement data must be recorded and submitted; 

--Entry and exit criteria for the program should be clearly 
spelled out and applied. In addition, parents- shoul d be 
informed of these criteria; 



-Problems with the scheduling of tutorial sessions should be 
addressed. Since the lunch-hour approach 1s problematic, 
the possibility of scheduling sessions during resource 
periods should be 1 pursued 1f feasible; 

-The Impact of the program on the admissions and placement of 
Spanish-dominant students should be assessed 1n an attempt 
to evaluate whether program students have been placed 1n more 
challenging majors than they might have been without Title 
VII services; 

-Since students' LAB scores Indicate the need for more than 
Intermittent E.S.L. assistance, the program director might 
discuss the need for additional E.S.L. Instruction with the 

.principal and other school administrators; 

-Since program students .1 nd1 ca.ted that their Spanish-language 
classes were not sufficiently challenging for native speakers 
the project director might work with the assistant principal 
responsible for foreign-language instruction to review the 
suitability of Spanish-language courses for program students; 

-The bilingual program might serve as a base for a Hispanic 
or bilingual club. The introduction of such a club might 
help to alleviate the lack of cohesion experienced by 
Hispanic students at Clara Barton. 

-The program objective concerning the CREST test be modified 
in terms of observed student performance and the dtywlde 
E.S.L. objective. 



r 
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I. CONTEXT 
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COMMUNITY SETTING 

Clara Barton High School for Health Professions stands ambnq the 
cultural facilities clustered near Brooklyn's Grand Amy Plaza. It faces 
the Brooklyn Botanical Gardens, a few minutes walk from the Brooklyn Museum 
and the Brooklyn Public Library. Prospect Helqhts High School „ the area's 
zoned school, 1s across the street. 

This area of Brooklyn divides Park Slope and Prospect Helqhts 
from Crown Helqhts. Residents of the school's Immediate vicinity are primarily 

black; a larqe West Indian population lives along Eastern Parkway, near 

i 

Clara Barton. Hassldic Jews, who live 1n Crown Helqhts, are represented 
among the school's faculty, but not Its student body. There 1s not a stronq 
Hispanic presence 1n this area. 

SCHOOL SETTING 

Built 1n 1939 1n art deco style, Clara Barton High School welcomes 
visitors Into an Impressive lobby, with a cathedral celling and a marble 

, Jo 



staircase leading to the principal's office. The school's deslqn reflects} 
its orlqinal aim: to prepare young women for homemaklng careers. Its class- 
rooms, planned for 25 or fewer students, are crowded when utilized by currjent 
classes of between 32 and 51 students. The rooms are furnished with fronlj 

5 

alcoves designed for demonstration lessons, and with ample pantry space. jA 

nine-mil Hon dollar renovation 1s soon to be undertaken to modernize some; 

of its facilities and to make the building accessible to handicapped students, 

staff, and visitors. / 

I 

The school is not zoned, but selects applicants from any pari of 

the dty who want to prepare for one of nine health occupations: b1o-nfed1cal 

/' 

science, dental assisting, dental lab assisting, health assisting, ttftan 
services, medical assisting, rehabilitative services, medical office/assist- 
ing, and practical nursing. Describing the school's goals, the pr1/id pal 
noted that the number of minority entrants Into the several health fields 
-- medicine, pharmacology, dentistry, veterinary medicine, optometry, and 
osteopathy -- has recently decreased despite recruitment and "educatl on at 
the college level. Clara Barton begins sooner -- at the high school level 
-- to prepare students for further education in the health professions, or 
to secure jobs on graduation. The most rigorous of Its programs leads to 
state certification as a licensed practical nurse. 

The school Is organized as a "mini-college." Students 1n grades 
nine and ten take, 1n addition to- mandated and academic classes, courses 
which provide overviews of the health occupations. By the end of the tenth 
grade, each student selects a major. Because some majors are more demanding 
than others, grade advisors work toward matching students with majors accord- 



1nq to Interest and ability, glvlnq the first choice whenever possible. 
The major governs programming for the final two years, since requirements 
have been established for each major. To meet these requirements, students 
take heavy programs: most take six classes plus physical education and 
lunch. While teachers work either from period one to eight or two to nine, 
about a quarter of the student body attends school from period one to nine; 
practical nursing students are scheduled for ten periods per day. 

The school stresses the sciences. A bloloqy course visited by 
the evaluator, described as a "mastery learning" course, appeared to be 
more challenqlnq than similar classes visited at other schools. The school 
tries, *1n its humanities courses, to Integrate Information about the health 
sciences. An English class was reading the novel Woman Doctor by Florence 
Haseltlne, M.D., and Yvonne Yaw. 1>ie school's Curriculum also provides 
opportunities for practical experiences. Students In the dental assistinq 
proqram, for example, work with dentists in a fuhctlonlnq clinic,' and dental 
fab assisting majors make false tetkh. Other students do volunteer work 
In nearby hospitals. 

The school's classrooms and corridors appear to be quiet and orderly. 
The bulldlnq betrays no slqns of vandalism. Barton's administration maintains 
a discipline unusual in public schools: the school day beqlns and ends with 
official classes, and students' coat*s are locked up durlnq the day; students 
sit at asslqned seats 1n the cafeteria. Disruptions by students are said 
to be rare; qenerally the threat of transfer to a student's zoned school 1s 
sufficient to Improve behavior. 



II. STUDENT CHARACTERISTICS 

i - 

SCHOOOl POPtttATIOlt ~ 

At one time a school for girls, Clara Barton is now co-educational, 
but continues to enroll 90 percent female and 10 percent male students. The 
school's student body of 2,527 is almost entirely minority students, of whom 
90 percent qualify for free lunch benefits. The ethnic breakdown of the 
school's population in 1981-82 was: \ „ ^ 



American Indian or Alaskan Native * 3 

Asian or Pacific Islander 31 

Hispanic 475 

White, non-Hispanic • 15 

Black, non-Hispanic 2003 



Among Clara Barton's black students are many from the West Indies who live 
near the school. Hispanic students constituted about 19 percent of -the - 
school's enrollment; this figure is slightly lower than the percentage of ^ 
Hispanic students in all Brooklyn high schools. The assistant principal 
for guidance mentioned that Hispanic students might account for a larger 
proportion of Barton students if not for two factors; first, that Hispanic 
youngsters, especially girls, tend to go to local schools rather than a non- 
zoned school out of the neighborhood; and that the school's rigorous require- 
ments and high academic standards have precluded the admission of students 
of limited English proficiency (LEP). (See Chapter III.) 

Attendance at Clara Barton is generally high. On the day of the 
site visit, the posted figure 85 percent -- was posted with the heading, 
"bad news.' 1 

*The New York City Board of Education's Annual School Census - Pupil Ethnic 
Composition Report (October 1980) stated that 21.6 percent of Brooklyn's 
high school students/ were Hispanic.^, 



PROGRAM STUDENTS 
Overview 

While the program originally proposed to serve fS students, that 
number was reduced when one paraprofessional was cut from the budget. The 
program got underway with 45 students 1n the fall; the number Increased to 
62 mid-year, and was 50 in May. Of the fifty program students, 45 came 
from communities 1n Brooklyn: Windsor Terrace, Crown Heights, and East 
New York. Four students came from Manhattan, and one from Queens. More 
than half were born 1n the continental United States; others were born 1n 
Puerto R1co, the Dominican Republic, Ecuador, Colombia, Panama, Guatemala, 
and El Salvador. Table 1 presents the number and percentages of students 
by countries of birth. 

Of the fifty program students, eight were male approximately 
the'same ratio as in the school. In the program office, male students 
were more'visible than female. Several seemed to stop by the office 
frequently, either for tutorial help or just to say hello to the project 
director. * (See Tables 2. and 3 for the distribution of students by sex 
and grade and age and grade.) 



TABLE 1 



Number and Percentages of Students by 
Country of Birth 

Language: Spanish 



Country of Birth 


Number 


Percent 


Puerto R1co 


6 


12 


Doffi1n1can Republic 


5 


10 


Guatemala 


1 


2 


El Salvador 


1 


2 


Panama 


3 


6 


Colombia 


1 


2 


Ecuador 


3 


6 


" Philippines 


1 


2 


U.S. 


' 28 


57 


TOTAL 


49 


100 









.More than half of the students 1n the program are United States 
born, speakers of Spanish. 

.Foreign-born students were born 1n Puerto R1co, the Dominican 
Republic, and Central and South American countries. 



TARLE ?. 

Number and Percentages of Students by Sex and Grade - 



I 

Grade | 


Male 
N 


Percent | 

of , 
Grade 


Female 
N 


Percent 

of 
Grade 


Total 
N 


Column Total : 
Percent 

of All Students 


9 




8 


100 


8 


16.3 


• 10 


7 


r 23 


24 


77 


31 


63.3 


11 




5 


100 


5 


10.2 


12 


1 


20 


4 


80 


5 


10.2 


TOTAL 


8 


16 


41 ' 




49 


100 



Eiqhty-four percent of proqram students are female. This 
'distribution by sex. reflects the school's past currlcular 
offerings: courses 1n preparation for homemaklng careers. 

.All students in grades 9 and 11 are female. 
.Most students are 1n grade 10. 
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TABLE 3 

Number of Students by Aqe and Grade 



Age 


Grade 9 


Grade 10 


Grade 11 


Grade 12 


Total 


14 


4 








4 • 


15 


3 


16 






19 


16 


1 


11 


2 




14 


17 




v 3 


\ 3 


5 


11 


Total 


8 


30 


1 

1 5 


5 


48 



Note. Shaded boxes Indicate expected, pge range for the grade. 

.Most program students are 15 years of age and in grade 10. 

.The majority of students are at the grade level expected for 
their age. 
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Language Proficiency 

About half the program students scored at or below the twentieth 

percentile on the English version of the Language Assessment Battery (LAB). 

(Figure 1 indicates the distribution of students' scores on the English LAB.) 

Most students did better on the Spanish version: half of those for whom 

scores were available scored above the fiftieth percentile. Comparing program 

students' grades with their LAB scores, the evaluator found that those who 
scored well 1n English and Spanish were doing well academically. Those with 
high LAB scores In Spanish were generally doing well even If thel r. Engl Ish 
LAB scores were very low. Thirteen students with English scores below the 
twenty-first percentile but scores above the fiftieth percentile on the 
Spanish LAB were for the most part performing well. One student, for 
example, maintained a 90 average In the honors' track although/he had scored 
in the fourth percentile In English; he scored In the eighty-fifth percentile 
1n Spanish. Students with low scores on the Spanish LAB were generally 
falling four or five of their courses. The other group of students falling 
most consistently were the eight U.S.-born students with English LAB scores 

. below the twenty-first percentile. 

Students seemed to be having the greatest difficulties with biology 
and world studies. Of 11 program students enrolled In biology 2. six had 
failed. 

The program director stated that most program students speak Spanish 
with friends; code-switching 1s typical. Most are more fluent In Spanish 
than English. Others speak English quite well, but experience Interference 
1n. reading English texts. 



FIGURE 1 



Distribution of Program Students' Scores 
on English Language Assessment Battery (N»50) 




20 30 40 50 60 ' 70 
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III. PROGRAM DESCRIPTION 

* 

G OALS 

The bilingual program at Clara Barton operates 1n a setting where 
LEP students would be expected to encounter academic problems. Every member • 
of the faculty or administration Interviewed by the evaluator stressed the 
demands placed'on Clara Barton students, who take science and health courses 
1n addition to mandated subjects. Except for the Title VII program, there 
were no supportive services geared to help bilingual students compete with 
their English-dominant peers. The non-graded English as a second language 
(E.S.L.) class offered theprevlous year was not offered 1n 1981-82; the 
principal said this was because the E.S.L. teacher was on sabbatical. 

The program was designed to provide tutorial support to LEP students 
(those scoring at or below the twentieth percentile on the LAB). The program 
director said that 1n addition to helping with content-area courses, the 
program sought to jnstlll confidence and to help students organize their 
studies and develop learning skills. 



1n: 



The program proposal predicted that Title VII services would result 

^--progress toward proficiency In English; 

--significant gains 1n Spanish-language achievement; 

--success 1n content areas comparable to that of English- 
dominant Barton students; 

--attendance records comparable to those of English-dominant 
Barton students. . 
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The proposal also stated that the program would work toward parental 
participation, staff training, and follow-up services for malnstreamed par- 
tldpants. 

* 

By offering students a. unit within the school with which to Identify, 
and by making staff available for advice and encouragement the program hoped 
to bolster students' motivation to remain 1n school despite the economic 
strain many experience at home, to reduce the Impact of culture shock, and 
to compensate for possible limitations 1n the education they received 1n 
the native country. 

ORGANIZATION 

Program Implementation was delayed until m1d-0ctober. The proposal 
had been submitted on February 13, 1981, but the official grant notification 
arrived f rom Washl ngton only on tfctober 15. At tha^tlme, the Division of 
High Schools authorized the project director's releasMfrom classroom re- 
sponsibilities. 

The project received funding for two full-time staff positions: 
the project director responsible for program Implementation, and a para- 
"professlonal who would carry out clerical tasks and record-keeping. Both 
staff members tutored students on an Individual basis during lunch periods. 

The project was originally housed on the first floor, ^rtear the 
cafeteria. Its convenient location allowed students to stop by after eating 
lunch; noise created by the many students taking part 1n a drug-prevention 
program, separated from the bilingual office by a glass partition, hampered 
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tutoring however, and the project was moved to a large, quiet room on the 
third floor. 

* > 

NEEDS ASSESSMENT 

By the time the proqram was underway 1n October, el1q1 ble'students , 
had been Identified on the basis of LAB scores and teachers 1 recommendations. 
Preliminary qrades were already available, so that the project dlrectqr 
could' analyze, subject by subject, students' academic liabilities. Passes 
were given to official teachers of eligible students; when students came 
to the office, the project director or paraprofesslonal explained that they 
needed extra tutoring. Studetits were Issued dally passes and were Invited 
to come to the program, of f 1ce during their lunch period, after they had 
finished eating, whenever they needed help. Parents were apprised of students' 
participation. 

SCHEDULING 

Program students take full programs of academic, vocational, and 
mandated courses 1n the mainstream. Ml participants take Spanish; all other 
courses are taught In English. 

The program was originally designed to operate on a^pull-out basis. 
However, tutorial sessions did not fit easily Into the already hectic schedules 
of Barton studen-ts. Tutoring therefore took place during the school's four 
40-m1nute lunch periods. Participating students- wou ; Vd typically eat lunch 
1n 15 or 20 minutes, then visit the program office for 20 minutes of tutoring. 
Two factors cut Into tutorial time, however. First, Barton students occupy 
assigned seats 1n the cafeteria and are summoned tableby table to the 
cafeteria line; students sometimes could not get their lunch for- some ''time. 

-13- 
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Secondly, the program office was some distance from the cafeteria. Students 
were Issued elevator passes for the lunch period to save time, but these were 
often not honored by the elevator attendants. 

TUTORIAL SERVICES 

The project director estimated that two or three students came 
for tutorial help during each lunch-period; for a total of eight to .ten per 
day. This number corresponded with the evaluator's observations during two 
days spent at the school. Actual services received by students were difficult 
to document, however, since the project had not maintained a log of students 
who sought or,rece1ved services. Work1ng"from a Hit of 50 project students, - 
the director estimated that 27 came with some regularity,- 13 sometimes appeared, 
and 10 rarely asked for help. Those who came for help most frequently were 
tenth" graders; of the ten juniors and seniors, one came frequently for assistance. 
The evaluator gained the Impression that several students "checked 1n" at 
the office very often, sometimes for tutorial help and other times just to 
say hello, and that the same students tended to ask for and receive 1 help 
often." The project director said that students -come whenever they want to, 
but most often before tests. s>"Before a holiday Almost no one comes," he 
added. The paraprofesslonal mentioned that one student came dally for three . 
months for help 1n two subjects. ^ 

The project director and paraprofesslonal often assisted students 
with cdntent-ar-ea subjects, particularly with biology. In some cases, students 
were helped, 1n tutorial sessions, to develop thel r own study aids, for example, 
to make flash cards of difficult biology. terminology. 



When students asked for help 1n math, they were sometimes referred 
to a volunteer tutor, who visited the schooT on a weekly basis to work with 
honor-track students but who helped bilingual program participants. Otherwise, 
students could work with either staff member. The project director said 
that boys tended to work with him while girls often sought out the female 
paraprofessional for assistance. 

When students came for assistance but had no specif^' problems, 
staff members would offer help with English (sometimes asking the student to 
to write a brief composition on the spot, and reviewing 1t with him or her), 
or with study skills. 

Both English and Spanish were used during tutorial sessions, de- 
pending on the work being covered. It appeared that Spanish was used for 
Informal conversation, while English was used to talk about academic subject 
matter. The project director said that they generally work 1n English. 
Students Interviewed during the site v1s1t'sa1d that they never came for 
help with Spanish. 

NON- INSTRUCTIONAL ACTIVITIES 
Parental Participation 

The project organized a Parents' Bilingual Advisory Council, con- 
sisting of seven parents.. Two meetings were held: one 1n May ,^1980 to 
explain the program, and another during 1981-82. It was difficult to enlist 
parents' participation since the school 1s not neighborhood based, and many 
students live some distance from Clara Barton. 
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Staff Development 

The bilingual staff consisted of two Individuals: the project 
director, who holds state and city certification In Spanish and bilingual* 
guidance and has six years of experience In bilingual education; and a para- 
professional, who holds an A. A. degree and has four years of experience in 
bilingual education and six years 1n E.S.L. 

Both staff members attended university courses: the coordinator 
was taking courses in guidance and special education during summer 1982, 
and the paraprofesslonal was attending education courses at Brook lyfr Col lege 
twice per week during the school year. 

No other staff development activities, 1n school or out of school, 
were reported. 

Supportive Services 

In addition to tax-1 evy . servl ces from the school's qrade advisors 
and guidance counselors, students received Informal advice and encouragement 
from the program staff. The project director stated that program students 
failed to achieve the same attendance figures as the school as a whole, 
stated that this would be difficult, since Clara Barton has^such a high 
attendance rate. 

POTENTIAL IMPACT OF THE PROGRAM 

While it is difficult to assess the Impact of the program's tutorial 

services, conversations *1th the assistant principal for guidance and the 

grade advisor suggested that the program's potential Impact on the school's 

admission and programming policies may be significant. 
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Impact on Admission Policy 

In the absence of supportive services, Clara Barton's administra- 
tion has been reluctant to admit students of limited English proficiency, * 
who might have difficulty with the school's curriculum. The assistant principal 
for guidance suggested that with a tutorial program, the faculty 1s more con-' 
fldent about teaching Spanish-dominant students, and bilingual students feel 
more secure at Clara Barton. "In the past they didn't feel they had a role 
here," he said, citing the small Hispanic population 1n the school's vicinity, 
and the lack of clubs or extracurricular activities geared to bilingual 
students. He added, "With Title VII support, we predict an Increase 1n the 
number of Hispanic students at Barton 1n the fall of 1982. A number of 
students were added on this basfs and there would be considerable growth 
reflected 1n the fall 1982 statistics." The percentage of Hispanic students 
for the four preceding years were: 

1978 21% 

1979 19% 

1980 20% 

1981 19X ^« 

Impact on Programming 

At the end of the tenth grade, students submit first, second, and 
third choices for a health profession major. A grade advisor then assigns 
students to majors on the basis of both Interest and ability: the majors, 
which vary 1n terms of academic difficulty, range from medical office assist-^ 
1ng the least demanding, to practical nursing, the most rigorous. J 

• The - grade advisor -stated that 1n the absence of supportive services, 

she\ould be reluctant to assign a student who was not a native speaker of 

English to practical nursing, b1o-med1caT science, or one of the other more 
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Challenging majors which require courses in body structure and function, 
chemistry, and other relatively sophisticated science* classes 1r\ addition 
to regular academic subjects. However, knowing that one-to-one assistance 
is available to LEP students, she is often willing to'allow a student to 
elect a more demanding major, one which opens up a more rewarding career 
path. She mentioned one student whom she assiqned to his first choice, 
health assisting, rather than medical office assisting, because he was in 
the Title VII program. 

p- 

She added that the bilingual program had already affected both 
the major requests of students — who had gained the confidence to set higher 
goals, and her final programming decisions. While half of the current upper- 
graders were enrolled in medical office assisting, the least demanding major, 
fewer than a fourth of the current tenth graders had been assigned to tlrts 
major. Six tenth graders had been assigned to the bio-medical science major, 
and one was assigned to practical nursing. 
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IV. FINDINGS 

ASSESSMENT PROCEDURES, INST RUMENTS . AND FINDINGS^ 

' The following section presents the assessment Instruments and 
procedures; and the results of the testing to evaluate student achieve- 
ment in 1981-1982. 

Students were assessed "in English-language development and growth 
1n their mastery of mathematics. The following are the areas assessed 

and the Instruments used: 

English as a second language - CTEST (Criterion Referenced 

En glish Syntax Test ), Levels I, II, Hi) 
Reading 1n English ~ .New York City Reading Test (P.S.E.N.) 

Mathematics performance - Now York City Mathematics Test, , 
(P.S.E.N.) | 
Attendance — School and program records 

The following analyses were performed: 

Oh pre/post standardized tests of English reading, and mathe- 
matics achievement statistical and educational significance are reported 
1n Tables 5 and 6, respectively. 

Statistical significance was determined through the application 
of the correlated t-test model. This statistical analysis demonstrates, 
whether the difference between pre-test and post-test mean scores is larger 
than would be expected by chance variation alone; I.e. 1 s statistical ly 
significant. 
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This analysis does not represent an estimate of how students 
would have performed in the absence of the program. No such estimate 
could be made because of the inapplicability of test norms for this 

population, and the unavailability of an appropriate comparison group. 

*> • 

Educational significance was determined for each grade level 
by calculating an "effect size" based on observed summary statistics 
using the procedure recommended by Cohe'fi. An effect, size for the cor- 
related t-test model is an estimate of the difference between pre-test 
and post-test means expressed in standard deviation units freed of the 
influence of sample size. It became desirable to establish such an 
estimate because substantial differences that do exist frequently fail 
to reach* statistical significance 1f the number of observations for each 
unit of statistical analysis 1s small.' Similarly, statistically signifi- 
cant difference's often are not educationally meaningful . 

Thus, statistical and educational significance permit a more 
meaningful appraisal of project outcomes. As a rule of thumb, the follow- 
ing effect size indices are recommended by Cohen as guides to Interpreting 
educational significance (ES): 

a difference of 1/5 = .20 = low ES 

a difference of 1/2 = .50 = moderate ES 

a difference of 4/5 = .80 = high ES 



*Jacob Cohen. Statistical Power Analysis for the Behavioral Sciences 
(Revised Edition)*. New York: Academic Press, 1977 Chapter Z. 



The instrument used to measure growth in English language was 
th» Criterion tefe^nrli English Syntax Test (CREST), which tests mastery 
of- specific syntactic skills at three levels. Material at 'the beginning 
and intermediate levels of the CREST is broken down into 25 objectives 
per level, such as preset-tense forms of the verb "to be"' (Level I), 
or possessive adjectives and pronouns (Level II). .Material at the .advanced 
level (Level III) is organized into 15 objectives, such as reflexive 
pronouns. At each level, students are asked to complete four items for 
each objective. An item consists of a sentence frame for wMch the 
students must supply a word or phrase chosen from four possibilities. 
Mastery of a skill objective .is determined by a student's ability to 
answer at least three out of four items correctly. 

This report provides information on the average number of 
objectives mastered and the average number of objectives mastered per 
month of treatment by students who received E.S.L. instruction (Table 4). 

U Rates of success of students in mathematics' and reading in 

English are reported by grade for students who were pre- and post.tested 
with the same test level. These tables contain the numbers of students by 
grade, the difference between the pre- and post-test, the standard 
deviation for each average score, the t test, and level of statistical 
and educational significance. 
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Comparisons of the attendance rates of program participants 
with that of the school as a whole are presented in Table 7. This table 
contains the average rate for the school and for the various participant 
groups, the percent differences, values of the z statistic, and its 
level of statistical significance. Although the z statistic used here 
is slightly different than that described above, it again Indicates the 
extent to which the observed percentage differences vary from what might 
be expected by chance. 



TABLE 4 

Performance of Students Tested on the Criterion Referenced 
En allsh Syntax Test (CREST): Average Number of Objectives 
Mastered by Grade and Test Level 
(E.S.L. Spanish- Speaking Students) 



LEVEL II 



Grade 



9 

10 
11 
12 



TOTAL 



Average 
Months of 
Treatment 



Average Number of 
Objectives Mastered 
Pre Post ' Gain 



6.1 
6.1 
6.1 



8 



14.1 23.5 
13-. 3 23.6 
8.7 21.0 



9.4 
10.4 
12.3 



Gain/ 
Month 



1.5 
1.7 
2.0 




Note: Number of objectives for each level: Level I (25), 
— Level II (25), Level III (15). 

.All of the Spanish-speaking students were pre- and post-tested 
at Level II. 

i' c„,nuh coeJiklnq program students mastered 1.7 
,In general, Spanlsh-speaiang pruyr <■ 

sssrwz - - %s?™«» s ~- cHteMon 

(see Recommendations)* 

\°jT,r% h! S'SIS "^JTri -.fS* Per ^ of ,nstr U c 
tlon. 
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TABLE 5 



English Reading Achievement 



1^6 



Significance of Mean Total Raw Score Differences Between Initial 
and Final Test Scores in English Reading Achievement of 
Students with Full Instructional Treatment ion the New York 
City Reading Test by Grade and Test! Level 



i 

I 



Test 
Level 


Grade 


N 


Pre- 
Mean 


■Test 
Standard 
Deviation 


Post- 
Mean 


-Test 
Standard 
Deviation 


Mean 

Difference 


/Corr. 
[Pre/post 


T- 

test 


Level of 
Significance 


Educational 
Significance 


9 


9 


7 


49.8 


13.5 


53.0 


13.6 


.3.1 


'; 0.94 


1.78 


NS 


0.85 


10 


10 


22 


44.0 


7.7 


48.6 


9.8 


4.5 


0.63 


2.73 


0.01 


0.73 


11 


11 


3 


39.0 


6.2 


42.2 


13.7 


3.3 


0.91 


0.68 


NS 




12 


12 


3 


50.0 


7.9 


49.6 


7.2 


-.333 


0.99 


-0.50 


NS 


-.57 



* Tenth-grade students were the only qroup to demonstrate a gain which was statistically 
and educationally significant. The ninth and eleventh grades did, however, show 
educationally significant Increases. 
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TABLE 6 
Mathematics Achievement 



S1an1f1cance of Mean Total- Raw Score Differences Between Initial 
S1 a 9 naWest Scores In Mathematics Achievement of Students 
with Full Instructional Treatment on the New York City 
Mathematics Test (P.S.E.N.) by Gride 



Grade 


N 


Pre- 
/Mean 


Test 
Standard 
Deviation 


Post 
Mean 


-Test 
Standard 
Deviation 


Mean 

Difference 


Corr. 
Pre/post 


T- 

test 


Level of 
Significance 


Educational ' 
S1qn1f Icance 


9 


7 


32,14 


9.17 


31.14 


7.56 


-1.00 


0.778 


-0.46 


.663 


;26 


10 


22 


33.10 


5.67 


35.14 


6.81 


2.04 


0.829 


2.52 


0.02 


.68 ' 


11 


3 


23.67 


8.08 


32.33 


8.33 


8.67 


0.991 


13.00 


0.006 


1.41 


12 


2 


33.00 


2.83 


40". 00 


1.41 


7.00 


-1.00 


2.33 


0.26 


1.30 



.Thirty-four program students were pre- end post-tested Kith this test. 
.Both tenth- end eleventh-grade studehts demonstrated gains thatyere statistically 
and educationally significant. j 

educational significance. 
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TABLE 7 



Significance of the Difference Between Attendance Percentage 
of Program Students and the Attendance Percentage of the School 



Grade 


N 


Mean 
Percentage 


Standard 
-Deviation 


9 


8 


90.3 


7.9 


10 


30 


94.5 


3.7 


11 


5 


87.8 


3.1 


12 


5 


94.9 


6.3 - 


TOTAL 


'48 


93.1 


5.2 



Average School -Wide Attendance Percentage: 86.13 
Percentage 

Difference - 6.9 z =■ 1.34 p - NS 



.Program students had a 93.1 average attendance rate. 

.The difference (6.9 percentage points) between the attendance 
percentage of program students (93.1 percent) and the attendance 
percentage of the school (86.1 percent) 1s not significant 
statistically. 

.The mean percentage ranged from a low of 87.8 1n grade 11 to a 
high of 94.9 1n grade 12. 

.The standard deviation ranged from a. low of 3.1 1n grade 11 to 
a high of 7.9 1n grade 9. 
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SUMMARY OF FINDINGS 
English Reading Achievement 

Overall, all program students demonstrated large gains from the 
pre- to the post-test on the New York City Reading Te st. Although the 
tenth-grade students were the only group to show an Increase that was 
both statistically and educationally significant, the ninth and eleventh 
grades did exhibit educationally significant differences. 

In general, Spanish-speaking program students mastered 1.7 
objectives per month of Instruction on the ^Criterion Referenced English 
Syrltax Test ((/REST). 

Mathematics Achievement 

In 1 general . the response to the N ew York City Mathematics Test 
were quite good for all students. Although the tenth- and eleventh-grade 
- students were the only grades to demonstrate gains that were both statis- 
tically and educationally significant, the twelfth grade showed a large 
increase from the pre- to the post-test that was highly educationally 
significant.* > 

Attendance * 

Although the difference between the attendance percentage of 

program Students and the attendance percentage of the school 1s not sta- 
tistically significant, the percentage 1s higher for the program students. 

Additional Tests 

The project also proposed to assess student outcomes In Spanish 

by using the Interamerlcan Series, la Prueba de Lectura, as well as student 

outcomes In mathematics, science, and social studies but did not provide 

data-in these areas. 

-27- 

J6 



\ 



V. CONCLUSIONS AHD RECOMMENDATIONS 

CONCLUSIONS 

— — — — - ^ 

Once 1t became operative 1n October, 1981, the bilingual program 
at Clara Barton provided tutorial services 'to Spa n 1 sh-s peak 1 ng students. 
About half of these students met the eligibility criterion specified In the 
proposal that 1s, they had scored below the twentieth percentile on the 
Language Assessment Battery . The remaining students were recommended by 
classroom teachers. 

Students came for tutoring on a voluntary basis during their lunch 
periods. There was no set schedule, no curriculum, and no clear pattern of 
attendance. The program did not maintain records to document the number of 
students served, the frequency of services, subject areas covered, or materials 
used. Students' work was not available 1n folders or any other form .for 
the evaluator to review. It 1s therefore difficult to draw firm conclusions 
about the Implementation of the program, "no less Its success. It appeared, 
during site visits, that at least a handful of students were calling on the 
two full-time staff members for help, and that a few looked upon the program > 
office as a home base -- a place to check 1n between or after class "i lt 
■ 1s altogether possible that the program in this way furnishes support wh1cfv v 
X is not quantifiable. However, 1n the absence of documentation, it can be 

concluded only that two full-time staff members provided Intermittent tutorial 
help to 50 students, of whom half sought assistance on a somewhat regular 
* basis. 

The program's major Impact may not yet be felt, however. In the 

absence of supportive bilingual services, the school has been reluctant or 
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unwilling to admit LEP students. Those students who were enrolled were often 
placed in the least challenging major, leading to relatively low-paying jobs 
which may not tap their ab U 1t1es. The presence of the Title VII program - 
may have^suQtlal Impact on these practices. In. turn, the* polldes'may 
place greaWdemands on the program^ tutorial services. # ^ 

RECOMMENDATIONS 

1. Record-Keeping : In order to better document program 

"activities, U 1s recommended that records be maintained on a dally basis 
to document: 

--the number of students s^fved; 

-the frequency of,Iu»rfNal sessions; ^ 

--subject areas covered; 

--1 anguage used; ^ ^ 

--materials used. 

If staff members ask program students to complete extra work, such as com-, 

positions in English, these might be maintained In permanent folders so that 

individual progress might be better assessed. 

2. Partici pant Selection : Entry and exit criteria should be 

modified to reflect existing program practice. The proposal stated that 
the program would serve students scoring at or below the twentieth per- 
centile on the LAB. In fact, about half of the p-rogram students scored . 
above this level, these students were offered tutorial assistance on 
teacher recommendations, as they regulred additional support to function 
•* effectively* 1n English language classes. 
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3. Schedul ing : The lunch-hour approach to tutoring is prob- 
lematic, because students may not hav$ the opportunity to get the support 
they need. The project director stated that he had'discussed with the 
principal the possibility of schedul ing program students for resource 
periods; 1f tjn's 1s feasible, 1t should be pursued, 

4. Impact of the Program on Admissions and Placement : Future 
evaluations might 'document the extent to which Spanish-dominant students 

have been recruited and enrolled at Barton, and might attempt to gauge whether 
program students have indeed been placed in more chal lenging majors'than 
they might have been without Title VH services, . tm 

5. English as a Second Language : On the t?asis of many students 1 

LAB scores, Spanish-domtnant students at Barton appear tct need E.S.L. f 
instruction, which was offered in 1980-81 but not in 1981-82, As E.S.L. 
addresses an important need for LEPlnetudents, it is recommended that the 
program director discuss this issue with the principal and other school 
administrators to facilitate the provision of E.S.L. instruction. 

i . / 

6. Spanish-Language Instruction : w Program students interviewed 

by the evaluator stated that thei r, Spanish-language classes were not sufficiently 
challenging for native speakers. The project director might work with the 
assistant principal responsible for foreign-language instruction to review 
the suitability of Spanish-language offerings for program participants. 

7. Bilingual Club : Members of the guidance staff mentioned lack 
of cohesion as one o/f the problems experienced by Hispanic students at Clara 
Barton. While the^school has several .active clubs, including a West Indian 
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Club, there seem to be no extracurricular activities oriented to the native 
culture of Hispanic students. The bilingual program might serve as a base 
for a club or for other activities. 

8. Parental Involvement : The minutes of a May 1980 orientation 
meeting for parents revealed that some participants were confused ^bout 
the "services offered by the program to their children. The program might 
therefore consider producing an information sheet or "newsletter" for* 
parental distribution which would include the program's aims and activities, 
student eligibility criteria; dates for future parent meetings, student » 
achievement, etc. 

9. Evaluation Objectives : The program objective of students 
mastering five curricular objectives per month of instruction is inappropri- 
ate, as if far beyond that set for students in Title I high school E.S.L. 
programs (one CREST objective .mastered per month). -It is recommended that 
in the future the program objective concerning the CREST test be modified 
in terms of observed student performance and the citywide E.S.L. objective. 
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